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SPECIFICATION 
age Display Device, Image Processing Method and Program 
[0001] 

Background of the Invention 

1. Field of the Invention 

The present invention relates to an image display device and an 
image processing method, wherein a desired color compensation is 
performed for an output image, as well as a program used therefor. 
[0002] 

2. Related Art 

In the case of an image display device such as a projector, the color 
of a displayed image may change because a color reproduction region differs 
depending on the type of the display device used. To avoid this 
inconvenience, there usually is performed a processing called color matching 
for matching color characteristics of the image display device used to color 
characteristics of a conventional CRT monitor. 
[0003] 

Further, in case of using an image display device such as a projector, 
it is important that an image intended by a producer be reproducible even if 
an external environment changes. Particularly, unless a change in 
brightness or color of external illumination or a change in color of a 
projection plane is taken into account as a change in external environment, 
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it is difficult to make an appropriate reproduction of color. 
[0004] 

For the aforesaid color matching and correction against the external 
environment there usually is employed a color correction table. 
[0005] 

Summary of Invention 

However, in the case of such an image display device as a projector, 
it is difficult to store a lot of data on a color correction table, due to a 
restriction imposed on the memory capacity. More particularly, in the case 
of a projector, it is necessary to store a suitable color correction table for 
each projector because of a significant difference between individual 
projectors. 
[0006] 

The present invention has been accomplished for solving the above- 
mentioned problem and it is an object of the invention to provide an image 
display device, an image processing method, and a program, which can 
reproduce color appropriately while saving the capacity of memory. 
[0007] 

According to the present invention as described in claim 1, an image 
display device for performing an image processing for an inputted image 
data, includes: a first color correction section which performs a desired color 
correction for the inputted image data on the basis of a characteristic value 
of the image display device and by reference to a three-dimensional color 
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correction table, the three- dimensional color correction table being for 
matching color characteristics of the image display device to reference color 
characteristics; and a second color correction section which performs a 
desired color correction for the inputted image data by reference to a one- 
dimensional color correction table, the one- dimensional color correction 
table being for making a color correction according to an external 
environment. 
[0008] 

According to the thus constructed image display device for 
performing an image processing for an inputted image data, by the first 
color correction section a desired color correction for the inputted image data 
is performed on the basis of a characteristic value of the image display 
device and by reference to a three-dimensional color correction table, the 
three-dimensional color correction table being for matching color 
characteristics of the image display device to reference color characteristics. 
Therefore, by the second color correction section a desired color correction 
for the inputted image data is performed by reference to a one-dimensional 
color correction table, the one -dimensional color correction table being for 
making a color correction according to an external environment. 
[0009] 

The present invention as described in claim 2, is an image display 
device according to claim 1, wherein the first color correction section is 
provided with a rewrite section for rewriting lattice point data of the three- 
dimensional color correction table on the basis of the characteristic value. 
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[0010] 

The present invention as described in claim 3, is an image display- 
device according to claim 1 or claim 2, wherein the one- dimensional color 
correction table used in the second color correction section is for adjusting 
the color temperature. 
[0011] 

The present invention as described in claim 4, is an image display 
device according to any one of claims 1 to 3, wherein the one-dimensional 
color correction table used in the second color correction section is for 
correction responsive to a change in brightness of an external illumination. 
[0012] 

The present invention as described in claim 5, is an image display 
device according to any one of claims 1 to 4, wherein the one- dimensional 
color correction table used in the second correction section is for correction 
responsive to a change in color of a projection plane. 
[0013] 

The present invention as described in claim 6, is an image display 
device according to any one of claims 1 to 5, wherein the one- dimensional 
color correction table used in the second color correction section is for 
correction responsive to a change in color of an external illumination. 
[0014] 

The present invention as described in claim 7, is an image display 
device according to any one of claims 1 to 6, further including section for 
inputting the characteristic value. 
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[0015] 

The present invention as described in claim 8, is an image display 
device according to any one of claims 1 to 7, which is a projector. 
[0016] 

The present invention as described in claim 9, is an image display 
device according to any one of claims 2 to 8, wherein the rewrite of lattice 
point data by the rewrite section is not performed when the characteristic 
value is a characteristic reference value. 
[0017] 

According to the present invention as described in claim 10, an 
image display method for performing an image processing for an inputted 
image data, includes: a first color correction step which performs a desired 
color correction for the inputted image data on the basis of a characteristic 
value of the image display device and by reference to a three-dimensional 
color correction table, the three-dimensional color correction table being for 
matching color characteristics of the image display device to reference color 
characteristics; and a second color correction step which performs a desired 
color correction for the inputted image data by reference to a one- 
dimensional color correction table, the one-dimensional color correction 
table being for making a color correction according to an external 
environment. 
[0018] 

The present invention as described in claim 11, is a computer- 
program of instructions for execution by the computer to perform an image 
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processing for an inputted image data, the image processing including- a 
first color correction processing which performs a desired color correction for 
the inputted image data on the basis of a characteristic value of the image 
display device and by reference to a three-dimensional color correction table, 
the three-dimensional color correction table being for matching color 
characteristics of the image display device to reference color characteristics; 
and a second color correction processing which performs a desired color 
correction for the inputted image data by reference to a one-dimensional 
color correction table, the one-dimensional color correction table being for 
making a color correction according to an external environment. 

Brief Description of the Drawings 

Fig. 1 is a functional block diagram of an image processor disposed 
within a projector according to a first embodiment of the present invention; 

Fig. 2 is a functional block diagram of an image processor disposed 
within a projector according to a second embodiment of the present 
invention; 

Fig. 3 is a flow chart for explaining a color correction table 
generating process carried out by a first color correction table generator 112; 

Fig. 4 is a flow chart for explaining a LUT data generating process 
which data are stored in a LUT data storage section 114; 

Fig. 5 is a diagram for explaining the LUT data generating process; 

Fig. 6 is a diagram for explaining a correlation between CRT colors 
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and projector colors; 

Fig. 7 is a flow chart for explaining the operation of the second color 
corrector 120 in the projector of the first embodiment; 

Fig. 8 is a flow chart for explaining a color correction table 
generation/rewrite processing executed by a second color correction table 
generator 150 in the projector of the first embodiment; 

Fig. 9 is a flow chart for explaining a correction curve calculation 
processing 1 (a correction with respect to a change in brightness of external 
illumination); 

Fig. 10 is a graph showing y curves in different environments; 
Fig. 11 is a graph showing normalized y curves in different 
environments; 

Fig. 12 is a graph showing a state in which normalized y curves in 
different environments are overlapped together at a reference point Do; 

Fig. 13 is a graph (l) showing an example of a correction curve 
obtained by changing the value of Do; 

Fig. 14 is a graph (2) showing an example of a correction curve 
obtained by changing the value of Do; 

Fig. 15 is a graph for explaining how to adjust the amount a 1 of 
correction of a 1 st correction curve; 

Fig. 16 is a flow chart for explaining a correction curve calculation 
processing 2 (a correction with respect to a change in color of projection 
plane); 

Fig. 17 is a flow chart for explaining a correction curve calculation 
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processing 3 (a correction with, respect to a change in color of external 
illumination); 

Fig. 18 is a diagram for explaining the principle of the 3 rd correction 

curve; 

Fig. 19 is a graph showing an example of a correction curve before a 
rounding process; 

Fig. 20 is a graph showing an example of a correction curve after a 
rounding process; 

Fig. 21 is a flow chart for explaining a color correction table 
generating process which can adjust the color temperature; and 

Fig. 22 is a diagram for explaining a color correction process carried 
out by a third color corrector 130. 

[0019] 

Description of the Preferred Embodiments 

Preferred embodiments of the present invention are described 
hereinafter with reference to the drawings. 
[0020] 

First Embodiment 
System Configuration 

Fig. 1 is a schematic explanatory diagram of a system which uses a 
projector 20 as an image display device according to an embodiment of the 
present invention. As examples of the image display device according to 
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the present invention axe also included CRT and liquid crystal display in 

addition to the projector. 

[0021] 

An image processor 100 disposed within a projector according to a 
first embodiment of the present invention is provided with a first color 
corrector 110 which performs color matching on the basis of a color 
correction table generated by a first color correction table generator 112, a 
second color corrector 120 which performs a desired color correction on the 
basis of a color correction table generated by a second color correction table 
generator 150, a third color corrector 130 for adjusting output 
characteristics of a liquid crystal light valve (L/V), and a L/V drive section 
140 for actuating the liquid crystal light valve to make a projection display 
of image. 
[0022] 

The image processor 100 is also provided with a y value input 
section 116 for the input of a 7 value of the projector, a LUT data storage 
section 114 which stores data (conversion values, LUT data) present in a 
color correction table and lattice point data in a correlated manner, the LUT 
data being for generating a three-dimensional color correction table (3D- 
LUT) for color matching, and the first color correction table generator 112 
which is for generating the three-dimensional color correction table for color 
matching on the basis of both y value inputted by the y value input 
section 116 and the data stored in the LUT data storage section 114. 
[0023] 
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The image processor 100 is further provided with a device 
characteristic storage memory 160 for the storage of color characteristic 
information of the projector when outputted to a reference projection plane 
within a dark room, an optical sensor 170 for measuring the luminance of 
light emitted from the projector and reflected by the screen and light from 
the external illumination reflected by the screen, and the second color 
correction table generator 150 for generating a one-dimensional color 
correction table (lD-LUT) taking the influence of external illumination into 
account and on the basis of both colorimetric value obtained by the optical 
sensor 170 and information stored in the device characteristic storage 
memory. 
[0024] 

In the projector of this first embodiment, first with reference to the 
color correction table generated by the first color correction table generator 
112, color matching is performed by the first color corrector 110 for an input 
image signal fed from a personal computer for example. Next, with 
reference to the color correction table generated by the second color 
correction table generator 150, the thus color-matched image signal is 
subjected to a desired color correction by the second color correction table 
120 taking the influence of external illumination into account. The image 
signal thus color-corrected is adjusted by the third color corrector 130 taking 
the output characteristics of the liquid crystal light valve into account. In 
accordance with an analog signal thus adjusted, the L/V drive section 140 
actuates the liquid crystal light value to make a projection display of image. 
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[0025] 

Processings such as a color correction table generation/rewrite 
processing performed by the image processor 100, which is described below, 
are carried out by executing an image processing program stored in a 
program storage section (not shown) provided in the projector. The 
program storage section constitutes a medium which stores the image 
processing program. The image processing program itself is also included 
in the scope of the present invention. 
[0026] 

M (l) Color correction in the first color corrector 110 

O 

p The first color corrector 110 performs color matching on the basis of 

y3 

p a three-dimensional color correction table generated in the following 

Q 

P manner by the first color correction table generator 112. 

_ (l-l) Processing by the first color correction table generator 112 

O 

%j Now with reference to Fig. 3, a description is given below about the 

fTl color correction table generating process carried out by the first color 

jTj correction table generator 112. 

[0027] 

First, upon input of a y value (projector characteristic value) of the 
projector from the y value input section 116 (S10, Yes), both intra-table 
data (conversion values, LUT data) and lattice point data stored in the LUT 
data storage section 114 which is disposed within a ROM of the projector are 
read into a RAM (S12). 
[0028] 
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On the basis of the inputted y value, the first color correction table 
generator 112 rewrites the lattice point data (S14). Since the intra-table 
data stored in the LUT data storage section 114 are prepared for a projector 
with a y value of 2.2 (characteristic reference value), it is necessary to 
rewrite the lattice point data on the basis of the projector's y value. More 
specifically, lattice point values (R, G, B) are converted to (R, G\ B') on the 
basis of the inputted y value and in accordance with: 

R' = R2-2/r 

G' = K z - 2/y 

B' = B 2 - 2/7 

[0029] 

The first color correction table generator 112 associates the 
converted lattice point values (R' 3 G', B') with the intra-table conversion 
values stored in the LUT data storage section 114 and generates a new 
three-dimensional color correction table (S16), then sets the thus-generated 
three- dimensional color correction table to the first color corrector 110 (S18) 
and terminates the processing. 
[0030] 

Constructing the first color corrector such that one three- 
dimensional color correction table is stored and lattice point data are 
rewritten on the basis of a y value of the projector, is for saving the 
memory capacity because a larger memory capacity is required for storing 
the three-dimensional correction table in comparison with the one- 
dimensional color correction table. 

12 



F006797USO0 



FEP0201US 



[0031] 

(1-2) Processing for generating LUT data stored in the LUT data 
storage section 114 

Next, with reference to Fig. 4, a description is given below about a 
processing for generating LUT data stored in the LUT data storage section 
114. The following description in this embodiment is of the case where 
color characteristics of the projector are to be matched to color 
characteristics (reference color characteristics) of CRT. 
[0032] 

First, a correlation is determined between input values (RcGcBc) in a 
CRT and color coordinates (e.g., XeY c Zo, L 0 *ao*b 0 *) of an output color (S20). 
With respect to a typical color, a correlation thereof is determined by 
outputting the color actually from the CRT and measuring the outputted 
light. As to remaining colors, their correlations are determined by an 
interpolating calculation for example. Then, a correlation is determined 
between an input value (R p GpB p ) in the projector and color coordinates (e.g., 
XpYpZp, Lp*a p *bp*) (S22) of an output color. Likewise, with respect to a 
typical color, a correlation thereof is determined by outputting the color 
actually from the projector and measuring the outputted light. As to 
remaining colors, their correlations are determined by an interpolating 
calculation for example. 
[0033] 

Next, there is determined an output color (Lp*a p *bp*) of the liquid 
crystal projector relative to an output color (L c *ac*bc*) of CRT (S24). 
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Usually, the same colors (L c *=Lp*, ac*=a p *, b c *=b p *) are mutually correlated. 
However, if the output color (L 0 *a c *b c *) o£ CRT is a color which cannot he 
outputted by the projector, a color relatively close to the output color, (e.g., a 
color which is the same in hue and the smallest in the distance on color 
coordinates with respect to the output color), among colors capable of being 
outputted by the projector, is selected and determined for correlation, as 
shown in Fig. 6. 
[0034] 

Then, as shown in. Fig. 5, R P G P B P values for R C G C B C values are 
determined on the basis of the correlations obtained in steps S20-S26 and 
LUT data are prepared (S28). 
[0035] 

In this embodiment it is assumed that the LUT data thus prepared 
and lattice point data are stored beforehand in the LUT data storage section 
114. 
[0036] 

(2) Color correction in the second color corrector 120 (color 
correction taking changes in the external environment into account) 

(2-1) Color correction taking changes in external illumination and 
projection plane into account 

Next, with reference to Fig. 7, the following description is provided 
about the operation of the second color corrector 120 in the projector 
according to the first embodiment of the present invention. 
[0037] 
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First, when the use of the projector according to the present 
invention is started, there is performed a color correction table 
generation/rewrite processing by the second color correction table generator 
150 (step 204). As to the color correction table generation/rewrite 
processing, it will be described below in detail with reference to Fig. 8. 
[0038] 

After the color correction table generation/rewrite processing, there 
is made image display on the basis of the image signal color-corrected by the 
second color corrector 120 and with reference to the rewritten color 
correction table (step 206). If the image display is not terminated (step 208, 
No) and if a certain time has not elapsed from the end of the last-time color 
correction table generation/rewrite processing (step 210, No), the state of 
image display in step 206 continues. On the other hand, if the display of 
image is not terminated (step 208, No) and a certain time has elapsed from 
the termination of the last-time color correction table generation/rewrite 
processing (step 210, Yes), the color correction table generation/rewrite 
processing is again performed taking into account the case where the 
brightness of external iHumination changes with the lapse of time (step 204) 
and there is made image display (step 206). According to the present 
invention, since the color correction table is rewritten at every certain time 
taking the brightness or color of external illumination or the color of 
projection plane also into account, an appropriate color reproduction is 
ensured even if the brightness or color of external illumination or the color 
of the projection plane changes. 
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[0039] 

In the case where the display of image is terminated, for example by 
turning OFF a power supply of the projector (step 208, Yes), the processing 
is ended. 
[0040] 

Color Correction Table Generation/Rewrite Processing 

Next, with reference to Fig. 8, a description is given about the color 
correction table generation/rewrite processing (the processing in step 204 in 
Fig. 7) which is performed by the second color correction table generator 150 
in the projector of the first embodiment. 
[0041] 

In the color correction table generation/rewrite processing, a 
correction curve calculation processing 1 (a correction with respect to change 
in. brightness of external illumination) (step 222), a correction curve 
calculation processing 2 (a correction with respect to change in color of 
projection plane) (step 223), and a correction curve calculation processing 3 
(a correction with respect to change in color of external illumination) (step 
224) are respectively performed. Next, three steps of correction curve 
rounding processes 1, 2 and 3 are performed (steps225, 226 and 227). The 
correction curve calculation processings 1, 2 and 3 and the correction curve 
rounding processes 1, 2 and 3 will be explained hereinafter. 
[0042] 

Next, on the basis of the correction curves thus calculated, there is 
generated a new one-dimensional color correction table. Then, the one- 
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dimensional color correction table, which is referred to in the second color 
corrector 120, is rewritten by the newly generated one- dimensional color 
correction table (step 228), and the processing flow returns to step 206. 
[0043] 

Correction Curve Calculation Processing 1 

(Correction with respect to change in brightness of external illumination) 

Next, a description is given about a correction curve calculation 
processing 1 with reference to Fig. 9. 
[0044] 

In the color correction table generation/rewrite processing 1, the 
O projector (image display device) 20 is caused to output white (R=G=B=255 

O gray scales) in a dark surround beforehand, the output light is allowed to be 

□ 

O reflected by the screen 10, and the reflected light is measured by the optical 

SI 

g sensor 170. 

3 [0045] 

ril In the color correction table generation/rewrite processing 1, with no 

O 

flj output from the projector 20, the luminance of external illumination light 

reflected by the screen 10 is measured (step 229). 
[0046] 

Next, tone curves are normalized in different environments (step 
230). Correction curves in all of W (white), R (red), G (green), and B (blue) 
are the same curves, and therefore, in this embodiment a correction curve is 
calculated with respect to W as an example. y curves in different 
environments (in a dark surround and in an illuminated surround) are 
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assumed as follows. The " y " represents a tone curve characteristic of the 
projector concerned. The value of y is ohtained by actually measuring the 
tone curve characteristic of the projector concerned and it is suitable to use 
a mean value as the value of y . In this embodiment, y is set equal to 2.2 
as an example. 

In a dark surround: 

Fd(Din)=Yw Din 7 - ... (l) 

In an illuminated surround"- 

Fi(Din)=YwDin 7 ' +Yi ... (2) 

tone curves in different environments are shown in Fig. 10. 

[0047] 

In the above equations, F represents a total luminance of lights 
reflected by the screen, Din represents normalized values 0 - 1 by 
normalizing digital input values (0 - 255 gray scales) of RGB, Yw represents 
the luminance of white in the projection, and Yi represents the luminance of 
iUunxination. Then, the equations (l) and (2) are norm aliz ed under the 
assumption that the eyes adapt themselves to luminances (Yw in a dark 
surround, Yw + Yi in an illuminated surround) detected when the projector 
outputs white in different environments. That is, the equations (l) and (2) 
are normalized so that the luminance (Yw in a dark surround, Yw + Yi in an 
illuminated surround) detected when the projector outputs white in each of 
different environments becomes 1. More specifically: 

In a dark surround* 

Fd(Din) = Fd(Din)/Yw = Bin 7 ... (3) 
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In an uluminated surround: 

Fi(Din) = Fi(Din)/(Yw + Yi) = (Yw - Din 7 + Yi)/(Yw + Yi) - (4) 

[0048] 

Normalized y curves in different environments are shown in Fig. 

11. 

[0049] 

Next, the y curves are overlapped each other at a reference point 
Do (step 232). As shown in Fig. 12, F'dCDin) is shifted in parallel in F' axis 
direction by only {F'i(Do) - F'd(Do)> so that F'd(Din) takes the same value as 

h= Fl(Din). More specifically: 

a 

O F'dCDin) = F'dCDin) + {F'i(Do) - F'd(Do)} 

| = F'dCDin) - F'dCDo) + Fi(Do) 

D If the equations C3) and C4) are used: 

F'dCDin) = Din 7, - Do y + (Yw - Do r + Yi)/CYw + Yi) — C5) 

Si [0050] 

Then, using the equation C5), a 1 st correction curve is calculated (step 

B 234). 

[0051] 

Thus, in this embodiment, as shown in Fig. 12, a 1 st correction curve 
is formed so that an output value of the correction curve in an illuminated 
surround coincides with an output value of the correction curve in a dark 
surround in the vicinity of the reference point Do. 
[0052] 

Then, the change in color of output image, which depends on 
19 
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whether an external illumination is present or not, is dimini shed by 
correcting input tone values so that a relative contrast (gradient of tone 
curve) in the vicinity of the reference point Do does not change depending on 
whether an external illumination is present or not. 
[0053] 

The above can be expressed by the following equation: 

[0054] 

F'i(Doutl)=F"d(Din) — (6) 

where Doutl represents input tone values corrected by the 1 st correction 
i=* curve. 

G Substitution of equations (4) and (5) into equation (6) gives- 

O (Yw • Doutl r +Yi)/(Yw + Yi) = Din y -Do r + (Yw - Do r + Yi)/(Yw + Yi) 

O Thus, 

Doutl = [(l+Yi/Yw)Dm r -(Yi/Yw)Do r ]i' r ••- (7) 

ri; 

The 1 st correction curve changes variously by changing the gradation 
value Do which serves as a center gradation value in correcting a lowering 

O 

m of contrast caused by illumination. Generally, if the value of Do is small, 

there is obtained Such a 1 st correction curve as shown in Fig. 13, and the 
projection screen looks whitish, affording a light tone. On the other hand, 
if the value of Do is made large, there is obtained such a 1 st correction curve 
as shown in Fig. 14, in which the projection screen is blackish as a whole 
and the gradation change in the low gray scale (gradation) region further 
decreases (what is called collapse of the low gray scale (gradation) region 
becomes conspicuous). By setting the value of Do at an appropriate value it 
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is possible to make such a correction as sharpness is most emphasized with 
little change in the entire brightness of projected image as compared with 
that before correction. As a result of experimental evaluation it turned out 
that a Do value near a middle gray scale (gradation) (0.25 ^Do ^0.50 or so) 
was suitable. 
[0055] 

Further, as shown in Fig. 15, the amount of correction can be 
adjusted by multiplying the amount of correction AF by a 1 (O^al^l). 
This is for preventing an unnatural image reproduction caused by an 
excessive correction. The equation (7) of Doutl in adjusting the amount of 
correction becomes as follows: 

Doutl = [(1 + a lYi/Yw)Din r -(a 1 • Yi/Yw)Do r ] 1/7 — (8) 

Therefore, the 1 st correction curves with respect to RGB colors are as 
follows: 

D R outl = [(l + a 1 - Yi/Yw)Dirin 7 '-(al - Yi/Yw)Do r ] 1/r — (9) 
D Q outl = [(l + ocl • Yi/Yw)Dain r -(al • Yi/Yw)Do r ]i" ... (i 0 ) 
D B outl = [(l + a 1 • Yi/Yw) D biii 7 -(al • Yi/Yw)Do r ]" 7 ' — (ll) 
[0056] 

Multiplying the amount of correction by a 1 eventually corresponds 
to multiplying the luminance of illumination, Yi, by a 1. It is preferable 
that the value of a 1 be within the range of 0.8^ al^l. 
[0057] 

As shown in the above equations (9)-(ll), the 1 st correction curves 
are calculated (step 234), the processing flow returns to step 223 of Fig. 8, 
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and , therefore, a correction curve calculation processing 2 is performed. 
[0058] 

Correction Curve Calculation Processing 2 

(Correction with respect to a change in color of projection plane); 

Next, with reference to Fig. 16, a description is given about the 
correction curve calculation processing 2. 
[0059] 

First, in the correction curve calculation processing 2, before using 
the projector 20 according to the present invention, E, (red), G (green), B 
(blue), and bk (black) colors are outputted to a reference projection plane 
from the projector (image display device) 20 in a dark surround and a 
luminance value of reflected light of each such color output reflected by the 
reference projection plane is measured by the optical sensor 170 and is 
stored in the device characteristic storage memory 160. As the reference 
projection plane there may be selected a projection plane whose reflectance 
in the visible light region is close to 1, such as a standard diffusion plate. 
[0060] 

Before using the projector 20 according to the present invention, in a 
dark surround, R (red), G (green), B (blue), and bk (black) colors are 
outputted to a projection plane to be corrected and a luminance value of 
reflected light of each such color output reflected by the projection plane is 
measured by the optical sensor 170. 
[0061] 

In the correction curve calculation processing 2, first, luminance 
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ratios of RGB colors on projection planes are calculated on the basis of the 
measured values Guminance values of reflected light of R (red), G (green), B 
(blue), and bk (black) colors reflected by the reference projection plane, and 
luminance values of reflected light of R (red), G (green), B (blue), and bk 
(black) colors reflected by the projection plane to be corrected) (step 242), 
which calculation is performed in accordance with the following equations: 

y R = (YR-Ybk)X(Y G -Ybk) (12) 

y G = (Y G - Ybk)X(Y G - Ybk) = 1 - (13) 

yB = (YB-Ybk)/(Y G -Ybk) (14) 
In the above equations, Yr, Yg, Yb, and Ybk represent luminances of R, G, B, 
and bk colors in the projector and yn, y G , and yB represent luminance ratios 
of RGB. In this case, yG is always 1 because the ratios are based on the 
luminance of G. Luminance ratios 5010, yao, and yBo of RGB on the reference 
projection plane are also calculated in the same manner. 
[0062] 

Next, a 2 nd correction curve is calculated (step 246). Primary colors 
(RGB) of the projector are not influenced by a change in chromaticity caused 
by a change of projection plane in comparison with secondary and tertiary 
colors. Therefore, if the luminance ratios ys, y G , and yB of the projection 
plane concerned are corrected so as to coincide with the luminance ratios vro, 
yGo, and yBo of the reference projection plane, a change in chromaticity 
caused by a difference of projection plane is corrected in all colors. If 
digital input values of RGB before correction are normalized in the range of 
0 to 1 as DRin2, D G in2, and DBin2, respectively, and digital input values of 
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RGB after correction are normalized in the range of 0 to 1 as DROut2, 
DGOut2, and DB0ut2, respectively, there are obtained the following correction 
curve equations - 

DROut2= [yR'/max(yn', ya, yB')3 1/7 X DRin2, yit = yRo/y& • • *(15) 

Daout2= [ya/ max(yn', yo', yB')] 1/r X Dain2, ya' = yao/ yG= 1 -'(16) 
DBOut2= [ys/ max(yR, ya, yB')] 1/7 xDBin2, yB = yBo/ yB —(17) 
In the above equations, max(yR', yo, vb') represent the maximum value 
among vr', ya , and yB'. In this way, a change in chromaticity caused by a 
difference of projection plane can be corrected colorimetrically. 
[0063] 

It is thus possible to correct colorimetrically a change in 
chromaticity caused by a difference of projection plane, but in case of 
adjusting the amount of correction, a 3 (0<o , 3<l), taking the adaptability 
of the human eyes and the effect of contrast into account, there are obtained 
the following correction curve equations - 

D R out2 = [ 1 - a 3(1 - yR'/max(yR 7 , ya', y B ')}] 1/r x DRin2 • ■ • (18) 
D G out2 = [1- a3{l-ya'/naax(yR 5 , ya', y B ')}] 1/r XD G in2 — (19) 
D B out2 = [l-a3{l-yB'/max(yR' ) yG J y B ')}] 1/r xDBin2 ••• (20) 

[0064] 

Here, 

ARgain= yn'/maxlyR, ya, y B ') 
AGgain=yG'/max(yR', y G J , Yb') 
ABgain=yB , Xmax(yR , 5 ya, y B ') 
Then, the equations (l8)-(20) are expressed as follows^ 
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D R out2={l -a3(l-ARgain)K r xDRin2 - (21) 
D G out2={ 1 - a3( 1 - AGgain)}i /r X D G in2 — (22) 
D B out2 = { 1 - aS( 1 - ABgain)}i /r x D B in2 — (23) 

[0065] 

If the color of the projection plane obtained by measurement is 
corrected 100% (aS = l), an exact correction is performed colorimetrically. 
In the presence of an external illumination, however, since the color of the 
projection plane is present around a projected image, the correction looks as 
if it were stronger than the actual correction due to a color contrast between 
the projected image and the projection plane and the effect of the eyes' 
adaptability to the external illumination. The amount of correction is 
adjusted to eliminate such a phenomenon. It is necessary that the amount 
of correction, <x 3, be adjusted while the evaluation of image is made 
actually under each environment. The value of a 3 is preferably in the 
range of 0.5 to 1.0. 
[0066] 

As shown in the above equations (2l)-(23), the 2 nd correction curve is 
calculated (step 246), the processing flow returns to step 224 of Fig. 8, and 
then, the correction curve calculation processing 3 is performed. 
[0067] 

Here, the correction curve calculation processing 1 and the 
correction curve calculation processing 2 are the processes for relatively 
correcting inputted values. Namely, with respect to the equations (9)-(ll) 
for the 1 st correction curve and the equations (2l)-(23) for the 2 nd correction 
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curve, the output values are obtained by multiplying the inputted values by 
correction parameters. Therefore, the order of the correction curve 
calculation processing 1 and the correction curve calculation processing 2 
can be exchanged. Namely, Step 222 of Fig. 8 and Step 223 of Fig. 8 can be 
exchanged. 
[0068] 

Correction Curve Calculation Processing 3 

(Correction with respect to a change in color of external iUumination); 

Next, with reference to Fig. 17, a description will be given about the 
correction curve calculation processing 3. 
[0069] 

In the correction curve calculation processing 3, R (red), G (green), B 
(blue), and bk (black) are outputted beforehand from the projector (image 
display device) 20 in a dark surround, then XYZ values of reflected lights 
obtained by reflection of those color outputs from the screen are measured 
with an optical sensor 170 and are stored in the device characteristic 
storage memory 160. In the absence of output from the projector; XYZ 
values of reflected light of the external illumination from the screen 10 are 
measured. 
[0070] 

In the correction curve calculation processing 3, first, the measured 
values (the XYZ values of the colors of the projector) are transformed into 
RGB values of the projector (step 250). In this embodiment, for 
representing the color of the external illumination in terms of RGB values, a 
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matrix M for the transformation between the projector RGB values and XYZ 
values is determined from the XYZ values of the colors of the projector. 
The matrix M and transformation expressions are as follows- 
[0071] 
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In the above expressions, Xc, Yc and Zc (c = R, G, B, bk) represent XYZ 
values of the colors R, G, B and bk in the projector, Dr, Dg, and Db represent 
normalized values obtained by standardizing digital input values (0 - 255) of 
RGB into the range from 0 to 1, and y represents a tone curve 
characteristic of the projector. As explained regarding the correction curve 
calculation processing 1, the value of 7 is actually measured and in this 
embodiment, y is set at 2.2 as an example. 
[0072] 

If XYZ values of illumination are assumed to be Xi, Yi and Zi, RGB 
values, ri, gi, and bi in the case of representing the illumination color as a 
mixed color of RGB in the projector are as follows : 
[0073] 
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[0074] 

Next, a 3 rd correction curve is calculated by using ri, gi, and bi (step 
254). Reproduction of a completely equal color is realized by substracting ri, 
gi, and bi obtained in the expression (27) as offset from the RGB outputs in 
the projector. But this method is not a practical method because the 
projector gradation collapses largely. 
[0075] 

In view of the above point, in this embodiment there is adopted such 
a method as shown in Fig. 18 in which differences ARoffset, AGoffset, and 
ABoffset from a means value of ri, gi, and bi are subtracted as offset. 
Therefore, the color generated by superimposing the offset color on the color 
of illumination corresponds to that of gray of the projector. 
[0076] 

In this way, it is colorimetrically possible to correct the influence of 
the illumination color, but in the case of adjusting the amount of correction 
while taking into account the adaptability of the human eyes and the effect 
of contrast, the values of ARoffset, AGoffset, and ABoffset are multiplied by 
a 2 (0<a2<l). If 100% (a2 = 1) correction is applied to the illumination 
color obtained by measurement, there is made a proper correction 
colorimetrically, but an unnatural image reproduction may result due to an 
overcorrection. The amount of correction is adjusted for eliminating this 
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phenomenon. It is necessary that the amount of correction a 2 be adjusted 
while making image evaluation actually in each environment. As the value 
of a2, a value in the range of 0.2 to 0.5 is preferable. 
[0077] 

The above correction processing is represented by the following 
expressions, provided only expressions of R will be given for the 
simplification of explanation. Here, r, g, b represent the RGB outputs of 
the projector, and r\ h' represent the RGB outputs of the projector after 
the correction processing. Namely, on the basis of the equation (26), by 
Jz adjusting the R output of the projector: r(Dii) (=Dr 7 ) • • • (28) 

5 with using the amount of correction a 2, the R output of the projector after 

the correction: r'(Dii) is represented by the following expressions: 

U 

Q r '(Dr) =DR r — a 2 A R offset — (29) 

ARoffset=ri-(ri+gi+bi)/3 

Ni If DRin3 represents inputted value before correction, and if Daout represents 

O 

III inputted value after correction, the 3 rd correction curve is represented by the 

□ 

fll following expression: 

r (D R out) = r '(DRin3) ■ • ■ (30) 
By using the equations (29) and (30), the 3 rd correction curve is represented 
by the following expression: 

DROut= (DRin3 y — a 2 A R offset) 1 /y — (31) 
In the same way, DGOut and DBOUt are represented by the following 
expressions: 

DGOut=(DGin3 r -a2AGoffset) 1/r — (32) 



F0O6797US00 



FEP0201US 



D B out=(PBm3 r -a:2ABoffset) 1/y — (33) 

[0078] 

A final correction curve is obtained by connecting the 1 st correction 
curve, the 2 nd correction curve and the 3 rd correction curve, which are 
calculated as explained before. Namely, if with respect to the equations (9> 
(11) and the equations (2l)-(23) 

JDidn2=DROutl 

Dain2=D G outl 

DBin2=D B outl 

and if with respect to the equations (2l)-(23) and the equations (3l)-(33) 
DRin3=DROut2 
Doin3=Daout2 
D B in3=D B out2 

the final correction curves are represented by the following expressions^ 
D R out=K 1 — «3( 1 - ARgain)} 

x {(1+ cc 1 • Yi/Yw)D Rin r - ( a 1 • Yi/Yw)Do 7 } - a 2 A R offset) ] 1 /y 
(34) 

Daout = [{ 1 - a 3( 1 - A Ggain)} 

x{(l+al • Yi/Yw)D G in 7 '-(al - Yi/Yw)Do r }- a2A Goffset) V /y 

- (35) 
D R out = [{ 1 - a 3( 1 - ABgain)} 

x {(1+ a 1 • Yi/Yw) D Bin 7 — ( a: 1 - Yi/Yw)Don~ a2A B offset) 3 ^ 
(36) 

[0079] 
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After the calculations of the expressions (34)-(36), if Ditout, Doout or 
DBOut is less than 0 (zero), Duout, Daout or Dsout is set at 0 (zero). On the 
other hand, if DBOut, Daout or DBOut is greater than 1, Ditout, DGOut or 
DBOut is set at 1. 
[0080] 

An example of the final correction curve is shown in Fig. 19. 

[0081] 

As shown in the above equations (34)-(36), the final correction 
curves are obtained (step 256), and therefore, a correction curve rounding 
process 1 with respect to step 225 of Fig. 8 is performed. 
[0082] 

Correction Curve Rounding Process 1 

Next, a correction curve rounding process 1 is executed (step 225). 

[0083] 

As shown in Fig. 19, with respect to the correction curve expressed 
by the equation (34), in a low gray scale (gradation) region and in a high 
gray scale (gradation) region, there are gradation levels in which Dout 
remains 0 (zero). Therefore, a correction curve rounding process is 
performed with respect to the correction curve in accordance with the 
following procedures. First, Dout4 is calculated from Dout by using the 
following equations: 

Dout4=[Dout- | (Dout- Din) | 0 ] (Dout>Din) — (37) 
Dout4=[Dout+ | (Dout— Din) | 0 ] (Dout<Din) — (38) 
In the above expressions (37) and (38), /? is a parameter indicating the 
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intensity of the rounding process. In accordance with, the evaluation result 
which is obtained by actually observing image, a suitable value of (3 is 
about 1.5. With respect to the equations (37) and (38), there can be 
generated a correction curve free of any gray scale (gradation) with Dout 
remaining at 0. After the correction curve rounding process 1 is completed, 
a correction curve rounding process 2 is performed. 
[0084] 

Correction Curve Rounding Process 2 

Next, a correction curve rounding process 2 is executed (step 226). 

[0085] 

In the correction curve rounding process 2, with respect to each of 
various points of the equations (37) and (38), a means is taken of a total of 
five points which are each point plus two points on the front side and two 
points on the rear side of each point. 
[0086] 

For example, if D in x 255 = 128, 
D out5(l28) = [ D out4(H2) + D out4(l20) + D out4(l28) + D out4(l36) 

+ Dout4(l44)]/5 — (39) 

The correction curve can be smoothed by performing the correction 
curve rounding process 2 
[0087] 

With respect to the following four points, i.e. D in x 255=0, 8, 248, 

255, 

D out5 (0) = D out4(0) • • • (40) 
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Dout5(8) = [Dout4(0) + Dout4(8) + Dout4(l6)]/3 — (41) 

Dout5(248) = [Dout4(240)+Dout4(248)+Dout4(255)]/3 (42) 
D out5(255) = D out4(255) • 1 * (43) 

Therefore, after the correction curve rounding process 2 is completed, a 

correction curve rounding process 3 is performed. 

[0088] 

Correction Curve Rounding Process 3 

Next, a correction curve rounding process 3 is executed (step 227). 

[0089] 

In the correction curve rounding process 3, D out6 is calculated by 
using the folio-wing equations: 

D out6 = D in + (D out5 — Din)[l — {(0.25 - D in)/0.25} e ] (Din X 255< 64) 

... (44) 

D out6 = D in + (D out5 — Din)[l — {(Din — 0 .75)/0.25> e ] (D in X 255 > 192) 

- (45) 

The "D out6" is the final result of correction. 
[0090] 

The result is shown in Fig. 20. As shown in Fig. 20, the correction 
is not performed in the vicinity of D in X 255=0 or D in X 255=255, and 
therefore, the maximum luminance of the projector and the contrast are 
maintained. In the above equations (44) and (45), "9" represents the 
parameter for adjusting the degree of attenuation of the correction amount 
in the vicinity of D in X 255=0 or D in X 255=255. In accordance with the 
evaluation result which is obtained by actually observing image, a suitable 
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value of 6 is about 5.0. 
10091] 

If Dout5(0) and Dout5(255) are zero, 
Dout6 = Dout5 

without performing the correction curve rounding process 3 (step 227). 
[0092] 

After the correction curve rounding process 3 is completed, the 
processing flow returns to step 228. 
[0093] 

Although in this embodiment one-dimensional color correction tables 
for the second color corrector 120 are generated successively and a color 
correction is made using a newly generated one- dimensional color correction 
table, there also may be adopted a construction such that a plurality of one- 
dimensional color correction tables are stored in advance and a color 
correction is performed using a predetermined one -dimensional color 
correction table according to an external environment. The reason is that 
in the case of a one -dimensional color correction table there is not required a 
large memory capacity in comparison with a three-dimensional color 
correction table and that therefore even pre-storage of plural one- 
dimensional color correction tables would pose no problem. 
[0094] 

(2 - 2) Adjustment of the color temp erature 

Referring now to Fig. 21, a color correction table generating process 
which can adjust the color temperature is described. In the previous 
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paragraph (2-1) there has been described an example in which the second 
color correction table generator 150 again carries out a color correction table 
generation/rewrite processing and the projector displays an image while 
making reference to the rewritten color correction table, taking into account 
the case where the brightness or color of an external illumination or the 
color of the projection plane changes. In this paragraph (2-2) a description 
will be given about the case where the second color correction table 
generator 150 generates a color correction table which can adjust the color 
temperature. 
[0095] 

As shown in Fig. 21, when the outputs of W (white), R (red), G 
(green), and B (blue) from the projector are maximum outputs, the second 
color correction table generator 150 measures XYZ values using the optical 
sensor 150 OS30). 
[0096] 

It is assumed that XYZ values are Xr, Yr, Zr, Xg, Yq, Zg," and Xb, Yb, 
Zb, when the outputs of R, G, and B are maximum outputs, respectively. 
Assuming that the projector possesses an ideal output characteristic 
represented by a predetermined gradation characteristic parameter y , the 
following relationship is established between inputted RGB values and XYZ 
values - 
[0097] 
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[0098] 

Next, there are set chromaticity coordinates xo, yo of a target white 
color point (S32). 
[0099] 

Then, XYZ values of the target white point are calculated (S34). 
More specifically, Xo, Yo, Zo values are determined from the values of Yr, Yg, 
Yb obtained in S30 and the xo, yo values set in S32 and in accordance with 
the following equations^ 

Yo=Yr + Yg + Y b 

Xo=Yo x xo/yo 

Zo=Y 0 x (1— xo— yo)/yo 

[0100] 

Next, RGB values (Ro, Go, B 0 ) necessary for developing the color of 
the white color point is determined (S3 6). 
[0101] 

The values of Ro, Go, Bo are determined as follows: 

[0102] 



Y R Y s Y B 
Zr %g %b 
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Ro = 255 X [ro / max(ro, go, bo)] 117 
Go = 255 X [go/max(ro, go, bo)] 1/r 
Bo = 255 X [bo / max(ro, go, bo)] 1/r 
Where, max (ro, go, bo) stand for maximum values of ro, go, bo, and a matrix 
index - 1 indicates that this matrix is an inverse matrix. 

Thus, input values R', G\ B' after color temperature adjustment are 
determined by the following equations (S38): 
R' = (Ro/255) X R ... (46) 

G' = (Go/255) X G ... (47) 

B' = (B 0 /255) X B ... (48) 

[0103] 

In this way the second color correction table generator 150 generates 
a color temperature- adjustable color correction table in accordance with the 
equations (46) to (48). Then, on the basis of the color correction table thus 
constructed the second color corrector 120 makes a color temperature 
adjustment. 
[0104] 

Although this embodiment is constructed in such a manner that one- 
dimensional color correction tables for the second color corrector 120 are 
generated successively and a color correction is made using a newly 
generated one-dimensional color correction table, there also may be adopted 
a construction such that a plurality of one- dimensional color correction 
tables are stored in advance and a color correction is made using a 
predetermined one-dimensional color correction table according to a 
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predetermined color temperature. The reason is that in the case of a one- 
dimensional color correction table there is not required such a large memory- 
capacity as in the case of a three-dimensional color correction table and that 
therefore no problem arises even if plural one- dimensional color correction 
tables are stored in advance. 
[0105] 

(2-3) Although in this embodiment both (2- 1) "color correction 
taking changes in ambient light and projection plane into account" and (2-2) 
"color correction for adjusting the color temperature" have been described 
each independently as an example of "color correction taking changes in the 
external environment into account " the color correction may also be made 
using a one-dimensional color correction table for color temperature 
adjustment after a color correction has been made using a one- dimensional 
color correction table which takes changes in ambient light and projection 
plane into account. 
[0106] 

(3) Color correction in the third color corrector 130 

Referring now to Fig. 22, the following description is provided about 

a color correction processing which is carried out by the third color corrector 

130. 

[0107] 

First, an output characteristic of the projector is set as shown in Fig. 
22(a) and an input/output characteristic of a liquid crystal panel is 
measured as shown in Fig. 22(b). Then, as shown in Fig. 22(c), there are 
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determined correlations between input signals and input values to the 

liquid crystal panel on the basis of Figs. 22(a) and (b). 

[0108] 

The third color corrector 130 adjusts the input value to the liquid 
crystal panel by reference to a color correction table which represents such 
correlations between input signals and input values to the liquid crystal 
panel as shown in Fig. 22(c). 
[0109] 

Second Embodiment 

Fig. 2 is a functional block diagram of an image processor 100 
disposed within a projector as an image display device according to a second 
embodiment of the present invention. As examples of the image display 
device according to the present invention there also are included a CRT and 
a liquid crystal display in addition to the projector. 
[0110] 

The image processor 100 disposed within the projector according to 
the second embodiment is provided with a y corrector 102 which rewrites 
lattice point data by reference to a one-dimensional color correction table 
generated by a first color correction table generator 112 and on the basis of 
an inputted y value, a first color corrector 110 which makes a desired color 
correction by reference to a three-dimensional color correction table (3D- 
LUT) constructed to perform a color matching for y = 2.2, a second color 
corrector 120 which makes a desired color correction on the basis of a color 
correction table generated by a second color correction table generator 150, a 
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third color corrector 130 for adjusting an output characteristic of a liquid 
crystal light valve, and a L/V (light valve) drive section 140 for actuating the 
light crystal light valve to make a projection display of image. 
[0111] 

The image processor 100 is also provided with a y value input 
section 116 for inputting a y value of the projector, a LUT data storage 
section 114 which stores lattice point data, and the first color correction 
table generator 112 which, in accordance with the inputted y value, 
generates a one-dimensional color correction tahle for rewriting the lattice 
point data stored in the LUT data storage section 114. 
[0112] 

As in the first embodiment, the image processor 100 is further 
provided with a device characteristic storage memory 160 for the storage of 
color characteristic information of the projector when outputted to a 
reference projection plane within a dark room, an optical sensor 170 for 
measuring the luminance of light emitted from the projector and reflected 
by the screen and light from the external illumination reflected by the 
screen, and a second color correction table generator 150 for generating a 
one- dimensional color correction table (ID -LUT) taking the influence of 
external iUumination into account and on the basis of both colorimetric 
value obtained by the optical sensor 170 and information stored in the 
device characteristic storage memory. 
[0113] 

In the image processor 100 of the second embodiment, the y 
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corrector 102 rewrites lattice point data on the basis of the inputted y 
value as in steps S12 and S14 shown in Fig. 3 and the first color corrector 
110 makes a desired color correction on the basis of the rewritten lattice 
point data and by reference to the three-dimensional color correction table 
(3D-LUT) for y = 2.2 (characteristic reference value). In this point the 
image processor 100 of this second embodiment is different from the image 
processor 100 of the first embodiment. Even with the y corrector 102 and 
the first color corrector 110 provided as in the second embodiment, it is 
possible to carry out the same processing as that carried out by the first 
color corrector 110 in the first embodiment. 
[0114] 

There also may be adopted a construction such that when y = 2.2 
(characteristic reference value) is inputted from the y value input section 
116, an input image signal is fed to the first color corrector 110 directly 
without going through the y corrector 102. 
[0115] 

As to the construction and operation of each of the second color 
corrector 120, the third color corrector 130, the L/V drive section 140, the 
second color correction table generator 150, the device characteristic storage 
memory 160, and the optical sensor 170, explanations thereof will here be 
omitted because they are the same as in the first embodiment. 
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